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Abstract 

We reconsider the Boltzmann-Gibbs statistical ensemble in thermodynamics using the multi- 
nomial coefficient approach. We show that an ensemble is defined by the determination of four 
statistical quantities, the element probabilities pi, the configuration probabilities Pj, the entropy S 
and the extremum constraints (EC). This distinction is of central importance for the understanding 
of the conditions under which a microcanonical, canonical and macrocanonical ensemble is defined. 
These three ensembles are characterized by the conservation of their sizes. A variation of the en- 
semble size creates difficulties in the definitions of the quadruplet {pi, Pj, S, EC}, giving rise for a 
generalization of the Boltzmann-Gibbs formalism, such one as introduced by Tsallis. We demon- 
strate that generalized thermodynamics represent a transformation of ordinary thermodynamics in 
such a way that the energy of the system remains conserved. From our results it becomes evident 
that Tsallis's formalism is a very specific generalization, however, not the only one. We also revisit 
the Jaynes's Maximum Entropy Principle, showing that in general it can lead to incorrect results 
and consider the appropriate corrections. 
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I. INTRODUCTION 



For many years the Boltzmann-Gibbs (BG) theory of statistical thermodynamics was 
untouched. The assumption that matter consists of particles has led to the connection 
between statistics and thermodynamics through the construction of a statistical ensemble. 
An ensemble in physics is a collection of identical (described by the same variables and 
exposed to the same physical conditions) microscopic systems. We shall denote them in 
the current study as configurations. When the size of the ensemble approaches infinity 
{thermodynamic limit), we obtain the macroscopic picture of the matter, which is defined 
through a set of configuration probabilities Pj. Instead of considering each configuration 
probability separately, we can introduce a characteristic combination of all Pj for the entire 
ensemble. We call this combination entropy S of the system. Its analytical expression 
depends on the statistical features of the ensemble. 

In the last two decades there has been a great effort to generalize the BG-theory, since 
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sufficiently by the probability distributions issued from BG-statistics. First, Tsallis in 1988 
introduced in his work a possible generalization of the BG-entropy, the S'J-entropy, 
depending on one parameter q. For g — > 1 we obtain Sj — » ^bg- Since then, various 
studies on generalized entropy structures and their respective probability distributions have 
been done The configuration probability distributions in all cases were 

computed by applying the Jaynes's maximum entropy principle. This principle sets the 
variation of a functional, with respect to the probabilities Pj, equal to zero. In Ref. 9| 
Tsallis showed thoroughly for the entropy Sj that the values of the parameter q describe 
correlations between the configuration probabilities. Although this study was only for the 
specific entropy Sj, the result about the role of the parameters can be extrapolated to every 
generalized entropy. 

However, despite the mathematical developments in this field jlO, H, 12] (and many 



others) it is not yet clear what is the physical essence of this scientific direction. The aim of 
the current work is to unveil this physical essence of the generalized BG-theory, exploring 
the conditions of constructing a BG-ensemble via the multinomial coefficient approach and 
obtaining the respective configuration probabilities from a purely statistical point of view, 
without utilizing physical laws. After this is done, we correspond the mathematical results to 
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the analogous physical situation, presenting the borderline between ordinary and generalized 
thermostatistics. The Jaynes's maximum entropy principle is also under the loop. We show 
that this formalism, as it is applied up until now, is generally not correct, and we consider 
the appropriate corrections. 

In Section [ITl we construct a random ensemble and derive the statistical quantities that 
characterize it. In Section UTTl we show how a modification in a random ensemble can change 
these statistical quantities. We present the condition under which the above statistical 
description breaks. In Section IIVI we give the connection of our results to thermodynamics. 
We demonstrate the mathematical steps for the construction of a generalized BG-ensemble 
and its physical meaning. In Section |Vl we draw our main conclusions. 

II. CONSTRUCTION OF A RANDOM ENSEMBLE 

We consider a random system A of the size N oo. Every space-position of the system 
is occupied by an element n^. We define Ni as the frequency of the element rii and W as 
the number of different types of elements. Then, the total number of the elements of the 
system is equal to its size = Yl^i ^i- The probability of finding certain types of elements 
is given by Pi = limN^oo Ni/N under the normalization constraint Yl^iPi ~ ^- ^^^^ 
them element probabilities. The statistical randomness in a system is defined through the 
independence of the elements and consequently of their probabilities Pi as well. 

Now, we want to organize the system A in a collection of configurations, each one of the 
size L. Then, the size of the system N can be written as 

N = XL, (1) 

where A is the sum of all repetitions of each configuration. If Ej is the total number of 
elements of all repetitions in each configuration j , then N can be given also asN =J2fi^^ Ej, 
where Q{L) is the maximum number of configurations without repetitions, depending on 
L. We denote Q{L) as maximum configuration function. Furthermore, we demand that 
the collection procedure preserves the randomness feature for the configurations as well 
(independence). The independence between the configurations is projected on the existence 
of Q{L). In general, when we have B elements consisting of W types, and Bi are the 
frequencies of each type of the elements, the number Q{B) is obtained by computing the 
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multinomial coefficient Cf . of the degree W: 

B\ 



w 



C 



Bi 



B\ X \[{l/B, 



(2) 



in the limit B ^ oo for equal element probabilities. In our case the analogous quantity of 
B is L. However, if we consider the limit L —>■ cxd, it is easy to see that the feature of the 
statistical randomness of the ensemble does not hold, e.g. L = N/2 with A = 2. What 
we actually wish to have is the inverse situation, A = N/2 and L = 2. Yet, how can we 
compute then Q{L)7 Since and L are proportional, the idea is to compute the multinomial 
coefficient ([2]) with B = N/X and Bi = Ni/X in the limit oo. Accordingly, we have 



n,ma) := lim C^/^ 



W 



i=l 



W 



e L^piln(l/pi 



(3) 
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where := X^J^i Pi ln(l/pi) ^ In(iy). Although, a has the structure of the Shannon- 
entropy [13], it is not an entropy but a constant, since the probabilities pi for a given system 
are constant. VL{L) is then defined when fi*(L, a) takes its maximum value (omax = In(iy)): 
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In further, let us consider the probabilities Pj of each configuration j. If all configurations 
have the same probability Pj, then this is given by 

1 1 



w- 



(5) 



with the normalization constraint Xljli'' ~ ^- -^l- © tells us that we can reach equal 
configuration probabilities Pj only if the element probabilities Pi are equal. If Pi Pk-, then 
the configurations are surely not equally probabilized, and the probabilities Pj present the 
structure 
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Pi P2 ■ ■ ■ Pw ' 



(6) 



where fj{pi) '■= fj{i)/Pi is the characteristic number for each configuration. The constraints 
for fj{i) read 

w 
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n{L) 



W 



(7) 
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We call the sum over i's in Eq. ((Tj) repetition weight of the configurations. Its connection 
with the repetitions of the possible configurations will become clear in equations to follow. In 
Table [T]we give a simple example for the values of fj{i) when L = 2 and W = 2 {^{L) = 4). 
We are easily able to verify that the sum of the configuration probabilities Pj is equal to the 
unity, Yl^=i Pj — (Pi + Pz)^ = 1- For all values of W and L this equality takes the form 



m 1 2 5 
m i i 1 



TABLE I: The configuration probabilities Pj and the terms fj{i) of the repetition weight for W = 2 
and L = 2. 



.i=l 



Pi 



(8) 



Eq. ([8]) will be very useful later. Considering Eq. ([7]) we can prove the following relation 

Q{L) 

The probabilities in Eq. ([6]) can be also expressed in a different way. We rewrite Pj in 
exponential form and make the substitution —pPj = LY^^i fj{i) In(pi). The negative sign 
is present because of the negative logarithmic term. /5 is a positive constant and Fj is now 
the new characteristic number of each configuration j. Then, Pj take the form 

The structure of Pj in Eq. ffTOj) is more familiar in thermodynamics. 

Now, let us investigate the inverse situation. For the above given probability distribution 
Pj we construct the respective ensemble and search for an appropriate statistical quantity 
for its description. If Mj is the frequency of each type of configuration j and M = Yl^=i 
is the total number of the configurations in the ensemble, then the probabilities Pj in Eq. ([6]) 
can be written as Pj = limjv/^oo Mj/M. The number of all possible ensembles which consists 



of the combination of M configurations, under the condition that Pj are independent, is given 
through the new muhinomial coefficient of the degree VL{L): 

M\ M\ 
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Considering Eq. (fTTj) in the hmit M — > oo we obtain the analogy to Eq. 
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Then, we define the following statistical quantity 



In 

^Sh(i:) := lim 



Q{L) 



(13) 



which is the well known Shannon-entropy of the ensemble. The Shannon entropy presents 
two very interesting and useful properties for a random system. First, if we replace Pj of 
Eq. ([6]) in the above equation, using Eq. ([9]), we obtain 

w 

Ssi^iL) =aL = LJ2P^H^/P^)■ (14) 

i=l 

As we can see, exponential distribution functions make Shannon entropy linear with respect 
to L, and because of Eq. ([T]), with respect to A^. We denote the exponential distribution 
functions which make an entropy extensive as Pj. Second, computing the derivation of the 
entropy f|T3|) with respect to Pj, replacing Pj through Pj of Eq. ffTOl) and then integrating 
with respect to Pj we obtain 



dSs^iPj 



dP, 



n{L) n{L) 



(15) 
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where a 
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1 is a constant with respect to the index j. We call the 



terms in Eq. 0151) Extremum Constraints (EC). These are composed of the normalization 
constraint (NC) and the mean value constraint (MVC). At this point we have introduced all 
appropriate statistical quantities for the description of a random ensemble. These quantities 
are given in the quadruplet {pi, Pj, S^hi EC} or equivalent {VL, Pj, S'sh, EC}. We would like 
to emphasize here that all four quantities depend structurally on each other. 



III. MODIFICATIONS IN A RANDOM ENSEMBLE 



We want to explore how the quadruplet {Q, Pj, Ssh, EC} changes if we insert random 
modifications in a random ensemble (the random modifications assure the conservation of 
the first term in the above quadruplet, Q, since we do not want to change the dynamic 
but to consider some perturbations of a purely random state). Therefore, let us consider 
the random test-ensemble A for L = 2, W = 2 and = 24, as demonstrated in Table HTl 
The element probabilities po and pi are equal p := po = pi = 1/2 and the configuration 
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TABLE II: Changes in the random ensemble A and accordingly in its configuration probabilities. 

probabilities {-Pj}j=oo,oi, lo, ii as well, Pqo = -Poi = -Pio = Pu = 1/4 = p^. We now change 
the position of two elements, as shown in the table, creating in this way the new ensemble 
B. The element probabilities pi remain the same in the new ensemble but the configuration 
probabilities are different. Thus, the ensemble B is not a pure random ensemble but a 
pseudo-random ensemble. In order to capture the changes in the probabilities Pj we extend 
the first relation in Eq. ([71) as follows 

where Cj cirG db positive constants. Then, for equal probabilities Pi, we obtain 

P,=p^c,. (17) 

The normalization constraint of P/s leads us to the definition of Cj's through the relation 
Y2^=i ^3 ~ ^{L). As we can verify from Eq. (ITTl) and the above table, for a random ensemble 
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Cj are equal to unity. For a pseudo-random ensemble (or modified random ensemble) we 
have Cj 7^ 1. At this point, it becomes clear why we called the sum in Eq. f fT6|) repetition 
weight. Eq. (IT7I) (or Eq. (ITBi) ) reproduces the probabihty results presented in Table [ITl 
When we organize a system in an ensemble we can succeed in having the repetition weight 
equal to unity. Yet, when we modify an already organized system, then it is most probable 
that the repetition weight is different from the unity. Because of the introduction of the 
terms Cj, Eq. ([9]) takes the form 

Y, P,m = P. (1 + j ■ (i**' 

Accordingly, the linear relation [T^ between Sq,\^{L) and L tends to 

SsY.{L)=aL + eL, (19) 

where := j^^^Ty Y^=i l^(l/ci)- Usually, is very small and thus negligible. However, 
even if it is not small enough, it is still negligible for L ^ 1, since the probabilities Pj 
decay exponentially with respect to L. Finally, it can be completely eliminated by the 
transformation fj{i) — Pi^^q^ ~^ fj{^)i where fj{^) = 1 is the new repetition weight. 
Thus, the Shannon entropy can remain linear with respect to L even when Cj 7^ 1 and 
consequently, because of Eq. ([T]), with respect to A^. 

Since, the probabilities Pj change by any modification in the configurations, it is clear 
that Fj's in Eq. f fTOj) change as well. In Table IIIIl we show under what conditions Fj 
changes and what structure it takes. Let us consider, at first, a random ensemble (c-,- = 1) 
with equal probabilities pj, Pj. Then, the values Fj are constant with respect to the index j 
and equal to Fj = ln(fi(L))//3. We denote this situation as ensemble of Type I. Our next step 
is to exchange elements rii randomly between the configuration repetitions. As previously 
mentioned, in this case we have generally Cj 7^ 1. Then, we can observe changes in Ej, thus 
Fj = Ej. We denote this situation as ensemble of Type 11. If the element exchange takes 
place between the ensemble and a reservoir of elements, in general Ni changes. Then, the 
probabilities Pj must be extended to an Aj-dependence and accordingly the structure of Fj 
tends to = Ej + /lAj, where /x is a proportionality constant. The normalization factor 
in Eq. ( JTOl) changes as well to 1/ ■ e~^^^'^ . We denote this situation as ensemble of Type 
in. In these three described cases the total number of elements A^, or in other words the size 
of the system, remains conserved. In the last case, we consider again the latter ensemble, 
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Ensemble Type^ I II III IV 

N XL XL XL X{N,L) 

constants N,Ni,Cj N,Ni N 

variables - cj Ni , cj N, Ni , Cj 

Fj Lln(iyV/3) Ej Ej+nNi {?] 

TABLE III: Statistical features of a modified random ensemble depending on the nature of the 
modifications. 



but now we allow also a variation of of the ensemble. Then, N and L are not connected 
through Eq. ([T]) but through a relation of the form = A(A^, L). If the last expression can 
not be solved analytically with respect to L, then the relations we have derived for Q{L), Pj, 
Ssh or EC are no longer valid. Consequently, we have observed that random modifications 
do not cause changes in the quadruplet {Q, Pj, Ssh, EC} as long as the size of the ensemble 
is conserved. 

Which one of the four above mentioned situations represents a statistical equilibrium! 
Mathematically, the answer is not strictly defined. It depends on the conservation law we 
prefer to emphasize, Cj, Ni or A^. We know only that when we have ensembles of Type IV 
all quantities vary, and thus the last situation can not be considered as a defining possibility 
of a statistical equilibrium. 



IV. CONNECTION TO THERMODYNAMICS 



By assuming that the elements rii correspond to physical particles, the quantity Ej to the 
energy of each configuration, the constant fi to the chemical potential of the ensemble, the 
expression e{—(3Ej) to the Boltzmann-factor and the modifications to physical interactions, 
we obtain successfully the connection between the above approach and ordinary statistical 
thermodynamics. The entropy f|T3l) is then called Boltzmann-Gibbs entropy. In thermody- 
namics the equilibrium state of a system under consideration is defined by the conservation 
of A^. This definition includes the ensembles of Type I - III which are denoted in literature 
as microcanonical, canonical and macrocanonical BG-ensemble, respectively. Eq. tells 
us that in a BG-equilibrium state the BG-entropy of the system does not take necessarily 
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its maximum value {pi = pk and cj = 1) but it becomes extensive (linear) with respect to 
the size of the system. 

As we have seen, in the case of an ensemble of Type IV is not conserved Ensembles 
of this type correspond to open interacting thermodynamical systems. Is the statistical 
description of such an ensemble possible? Generally, it is not easy to answer this question. 
Usually, when we explore a system we do not know from the start its statistical features 
which are projected on the probability distribution sets {pi}i=i,2...,w and {Pj}j=i,2,...,n(L)- 
Thus, there is a great difficulty to construct the appropriate multinomial coefficient from 
which we can obtain the quadruplet of the system {Q, Pj, S, EC}. 

A possible way to overcome this difficulty is to generalize the multinomial coefficient in 
Eq. ([2]), or in other words, to consider correlated probabilities Pi and Pj, separately. The 
multinomial coefficient ([2]) is based on two operations, multiplication and division {x,/}. 
So, the idea is to generalize these two operations in order to obtain a generalized multinomial 
coefficient. A generalized multiplication or division {(S>q, 0q} depends on a parameter set 
Q = {Qi}i=i...m and tends to the ordinary ones for certain values Qo of the parameters, 
{®Q, 0q} {®So7 0So} = /}• How can we generalize multiplication and division? 
For the elements x, y E M+ these operations can be written as 

x^QoV = X X y = e{\n{x) +ln{y)) , (20) 
x(Z)Qoy = X /y = e{\n{x) -\n{y)) . (21) 

Here, it becomes obvious that the generalization of the operations {x, /} can be succeeded 
through deformed logarithmic and exponential functions. Thus, we have 

x^Qy = eQ (InQ(x) + InQ(y)) , (22) 
x0Qy = eQ {\nQ{x) - \nQ{y)) . (23) 

with eQg{x) = e^ and Ihq^^x) = ln(x). In the definition of InQ(x) (or egi^x)) we demand 
that the equality Ing(l) = (or eQ(0) = 1) is fulfilled. In this way we obtain new maxi- 
mum configuration functions Qq{L), new configuration probability distributions Pj^\ new 
entropy structures Sq and new extremum constraints ECg. All these new quantities con- 
stitute a generalized Boltzmann-Gibbs ensemble. So, within this generalization we are able 
to find a Q-probability distribution which makes the respective Q-entropy extensive with 
respect to the size of the system N (or L). What is the physical essence of the generalization 
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procedure described above? We consider an ensemble, whose total number of particles, for 
some entropies is not conserved and for some others is conserved. It becomes evident, that 
a generalized BG-ensemble is a transformed BG-ensemble. The values of the parameters Q 
are characteristic for every transformed ensemble. Indeed, if we transform the probabilities 
Pj in BG-entropy as follows 



P.. 



(24) 



w[pj^hnQil/Pj^^ 

where W[x] is the Lambert function and the probabilities pi in such a way that Q{L) — > 
Qq{L), then we obtain any generalized trace-form entropy Sq = Y^^=i^^ ^j^^ ^^q{^/ ^j^^)- 
For non-trace-form entropies we transform a function of the probabilities Pj, H{Pj). In the 
transformed ensemble the normalization condition for the new probabilities Pj^^ is given by 
the generalization of Eq. ([8]) as follows: 

Ep. =1. (25) 

j=l \i=l / 

where the generalized exponent, according to Eq. ( |22l) . has the form x®2 = eg (alnQ(a;)). 
The probabilities Pj are not normalized in the transformed ensemble, since Q{L) is also 
transformed. The question that arises from the ensemble-transformation is whether the 
physics of the BG-ensemble, which is projected on the definition of the extremum constraints 
( ITSjl . does not change. We shall return to this point in the next paragraph. 

Up to now, all proposals for a possible generalization of the BG-statistics are mostly based 



only on the generalization of the BG-entropy structure. By applying the 



one could derive the respective probability distributions using ad hoc 
extremum constraints in Eq. (fT5|) : 



aynes's formal 
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ism, 



16| the 



^^Sr^ = E(" + '3^-.)- (26) 

where a and (3 correspond to the Lagrangian multiplicators. However, we showed in Eq. 
(I15p that the structure of the right hand side of Eq. fl2Bl) is valid only for the probabilities 
(E]) and the entropy (|T3l) . So, the use of the formalism in Eq. (1261) for an arbitrary entropy 
structure leads in general to incorrect results. Comparing Eqs. (fT5|) and (!26l) we see that 
the correct expression of the variation functional I in Jaynes's maximum entropy principle 
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is of the form 



3 ' L r5P'^®^ 



dP'l^\ (27) 



p/(S)^-p/(e) 



In other words, in general we can not compute the maximum entropy probabihties (config- 
uration probabihties) -Pj^^ from Jaynes's principle because we first need to know them in 
order to obtain the extremum constraints. Very recently, in Ref. jl^ the present author 
has constructed two generalized multinomial coefficients and shown, among others, that the 
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ordinary exponential function and not a g-exponential one [6|, which is derived from Eq. 
( l26l) . On the other hand, it is remarkable that in the case of Tsallis entropy the Jaynes's 



formalism fl26l) does give the correct results 17|]. Let us shed light on this point. The in- 



ner structure of the BG-entropy has the expression xln(l/x). From the derivation of this 
expression we obtain 

d 

— [xln(l/x)] = ln(l/x) - 1. (28) 

Then, the Jaynes's formalism in Eq. fl26l) can lead to correct results only if the entropy is 
of trace-form, Sq = Yl^=i^^ ^j^^ l'^Q(l/-P;-^'')i the following relation is fulfilled 

[xlnQ(l/x)] = Ai(Q) lnQ(l/x) + A2(Q), (29) 



d_ 
dx 



where Ai(Q), \2{Q) are constants with Ai(Qo) = — A2(Qo) = 1- Solving the differential 
equation ( l29l) and considering the appropriate boundary conditions, we obtain the general- 
ized logarithm 

a;i-Ai(Q) _ I 

Accordingly, this is the only logarithmic-like function for the entropy Sq which preserves the 
structure of the right hand side in Eq. (!26|) (or the EC in Eq. (fT5|) ). When the transformation 
of the BG-ensemble is based on the deformed logarithm fl30|) and the obtained entropy is of 
trace-form, then the physics of the BG-ensemble does not change after the transformation. 
Indeed, one can verify, that the transformation rule in Eq. fl2^ is only invertible when the 
deformed logarithm has the form (1301) . Considering only one parameter Q = Xi{Q) = q 
in Eq. (!30!) . the obtained entropy based on the deformed logarithm Inq(x) is the Tsallis 
entropy. 
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V. CONCLUSIONS 



We have shown that a statistical ensemble is defined through four quantities, the element 
probabilities Pi, which refer to the ensemble elements rii and lead to the maximum number 
of all possible configurations fi{L), the configuration probabilities Pj, the entropy S and 
the extremum constraints (EC) of the ensemble, like the probability normalization and the 
mean value constraints. The explicit structure of these quantities for a random ensemble 
is derived. The structure of each quantity of the quadruple {fl, Pj, Ssh, EC} depends on 
the structure of the other quantities. We demonstrated that non of these structures changes 
under random modifications in the ensemble if the size of the ensemble is conserved. It 
is well known that a random ensemble corresponds to the Boltzmann-Gibbs ensemble in 
physics. So, we corresponded our results to statistical thermodynamics by assuming that 
the elements represent physical particles. When the total number of particles N in the 
Boltzmann-Gibbs ensemble is conserved, we have statistical Boltzmann-Gibbs equilibrium 
and the Boltzmann-Gibbs entropy becomes extensive with respect to A^. If is not con- 
served then the Boltzmann-Gibbs entropy can not be defined and the appropriate entropy 
is to be found in the area of generalized Boltzmann-Gibbs statistics, introduced first by 
Tsallis. We demonstrated that generalized ensembles based on deformed logarithmic and 
exponential function transform the Boltzmann-Gibbs ensemble in such a way that is con- 
served. This result is of great importance in physics because the conservation of the size 
of the Boltzmann-Gibbs ensemble is equivalent to the conservation of its energy Ej, since 
N = E?it^ Ej. From our approach becomes clear that the parameters of the generalized 
ensembles, which represent correlations between the probabilities, do not describe correla- 
tions that we detect but correlations that we create, so that we obtain A^ = conserved. 
Generalized ensembles based on the deformed logarithm (!30l) do not change the physics of 
the Boltzmann-Gibbs ensemble after the transformation. 
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